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1,  INTRODUCTION, 

Row  to  combine  the  results  of  k  independent  tests  of 
significance  has  long  been  an  important  problem  in  statistics.  The  problem 
can  arise,  for  example,  in  such  diverse  situations  as  when  tests  on  the  mean 
survival  time  after  diagnosis  of  a  terminal  disease  are  made  on  k  groups 
of  patients  in  different  hospitals-,  or  when  the  sets  of  observations  in  k 
cells  of  an  ANOVA  table  are  separately  tested  for  normality.  An  important 
feature  of  such  tests  is  that  often  the  individual  sample  sizes  will  be 
small,  so  that  asymptotic  results  will  not  necessarily  be  valid.  We  suggest 
below  that  they  might  even  be  misleading  in  some  situations , 

Although  work  was  done  on  this  problem  many  years  earlier,  we 

* 

base  our  discussion  on  a  very  comprehensive  examination  of  both  test 

situations  and  techniques  by  Birnbaum  0.9541.  The  techniques  studied  use 

the  significance  levels,  or  p-levels,  of  the  individual  tests, and  they 

include  the  following.  Suppose  Plfp2 » • « • are  the  individual  p-levels, 

of  test  statistics  t^^, . . .  ,t^  .  Fisher's  statistic  (perhaps  the  most 

widely  used)  for  combining  the  test  results  is  t  =  —  22  log  p^  (all 

logari thins  are  natural  logarithms,  and  all  sums  or  maxima  or  minima  are  over 

i  from  1  to  k) .  A  similar  statistic  is  Pearson ks-  T^  =  -22  log  q^  where 

q.  =  1  -  p.  .  Two  other  statistics  are  TM  =  max  p.,  and  =  min  p.  ; 
i  i  *1  *1 

these  are  special  cases  of  Statistics  derived  from  methods  developed  by 

Wilkinson  (Birnbaum,  1954,  p.  562,  with  r  =  1  or  r  =  k  respectively). 

Birnbaum  gives  a  very  careful  discussion  of  these  statistics,  in  particular 

against  two  types  of  alternative  to  the  oyezall  null  hypothesis,  which  we  call 

H  .  If  the  individual  null  hypotheses  are  H  i  =  l,..,,k,  H 
oo  oi  oo 

H  all  H  .  are.  true, 
oo  or 


is 
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It  is  well  known  that  when  all  ^  ar>  true,  the  p^  will  be  uniformly 
distributed  between  0  and  1,  written  U(0,1);  then  and  TP  each 

2 

have  the  X,.  distribution.  Bimbaum' s  alternatives  to  H  are 
2k  oo 

H^:  all  are  false  together,  or 

H„ :  one  or  more  of  the  H  ..  are  false, 

B  oi 

Bimbaum  expressed  and  If,  in  terms  of  the  alternative  densities 

g.(p.)  of  the  p-values.  On  H  ,  all  p..  have  the  same  (.unknown) ,  non-' 

IX  A  X 

increasing  densities  g (p . J ,  and  on  H„ ,  one  or  more  of  the  p .  have 

1  B  1 

(unknown)  non-uniform  densities  g.CpJ. ,  It  is  probably  true  that  in 

X  X 
% 

almost  all  test  situations,  or  will  express  the  expected 

alternative  to  H  .  To  quote  Bimbaum: 
oo  ^ 

"Under  H, ,  the  t . ’ s  are  statistics  of  the  same  kind  obtained  from  k 

replications  of  an  experiment,  in  which  the  underlying  conditions  are 

assumed  to  remain  constant  with.  Hqq  false.  Under  H^,  the  t^'s  may  be 

statistics  of  different  kinds  (for  example,  a  normal  mean  and  a  normal 
variance),  and  the  conditions  under  which  the  t^s  are  obtained  need  not 
be  the  same;  it  is  assumed  only  that  H  is  false  in  the  case  of  at  least 
one  of  the  t^'s.  is  seen  to  be  a  special  case  of  ,  Probably  in 

the  majority  of  applications,  H  is  the  appropriate  alternative 

hypothesis.  (In  this  quote  and  again  below,  we  use  H  ,  our  notation) . 

oo 

Bimbaum  goes  on  to  prove  that  the  best  test  of  Hqo  against  any 
particular  satisfies  his  Condition  1;  that  if  Hqo  is  rejected  for  any 

given  set  of  p^,  then  it  must  be  rejected  for  p-values  p^  such  that 
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p?  Sp.,  for  all  i  .  Then  Birnbaum  shows  that  for  each,  method  of 

combination  of  p~valu.es  satisfying  Condition  1,  "we  can  find  some 
alternative  Hg  ...  against  which,  that  method  of  combination  gives  a  best 

test  of  H  "  . 

oo 

Subsequently,  Littell  and  Folks  (.1971,  1973}  have  studied 
.  .  _F  M  m 

statistics  t  ,  T  ,  and  T  from  the  point  of  view  of  Bahadur  efficiency. 
They  included  also  the  statistic  T^  =  2$  ^  (q^.) ,  where  is  the 

inverse  of  the  standard  normal  distribution  function.  Fisher Ks  statistic 

performs  well  by  the  criteria  of  both.  Bimbaum  (admissibility!  and  Littell 

and  Folks  (asymptotic  Bahadur  efficiency!. .  However,  there  are  two  important 

reasons  why  asymptotic  considerations  may-  not  be  valid.  Firstly,  under 

♦ 

alternative  H^  ,  the  conditions  for  examining  Bahadur  efficiency  may  not 
be  realized;  and  secondly,  combinations  of  tests  will  often  be  done  with 
relatively  small  samples,  so  that  asymptotic  results  will  not  apply. 

In  this  article  we  concentrate  on  a  comparison  of  the  Fisher 
statistic  T^  (which  has  become  well-established!  and  the  Pearson  TP  . 

We  first  discuss  asymptotics  in  Section  2.  Since,  as  far  as  we  know,  ' 
Bahadur  efficiency  has  not  been  examined  for  T  ,  we  fill  in  that 

P 

gap,  so  that  T  may  be  compared  from  this  point  of  view  with  the  other 
statistics.  TP  is  shown  to  be  equivalent  to  TM  and,  by  these  asymptotic 

,  p 

considerations,  will  be  inferior  to  T  . 
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In  Sections  3  and  4  we  turn  to  small-sample  issues. 

p 

Section  3  contains  an  example  from  Fisher's  works,  for  which  T  is  more 
sensitive  than  This  is,  of  course  only  one  example,  and  in  Section  4 

we  discuss  small  sample  results  more  thoroughly.  Three  families  of- 
alternative  distributions  for  p  are  suggested,  which  might  well  be 

—  .p' 

reasonable  representations  of  situations  and  Hg  .  For  one  of  these  T 

p 

will  be  the  statistic  of  choice,  and  for  the  other,  T  .  This  prompts  further 

investigation  by  Monte  Carlo  methods,  of  the  important  small-sample  situation, 

and  the  results  twhich.  include  other  statistics!  are  given  in  Tables  1  and  2. 

They  support  the  view-  that  there  will  be  occasions  when  the  Pearson  statistic, 

N 

and  also  T  ,  should  be  calculated. 


2.  ASYMPTOTIC  RESULTS  ON  EFFICIENCY. 


2.1  Bahadur  efficiency  for  Pearson's  method. 


In  this  section  we  introduce  more  detailed  notation  to  examine  the 
various  methods  of  combining  k  tests.  Suppose  now  that 
tCl,^)  ,t(2;n2),...,t(k;nJjl  are  independent  test  statistics,  based  on 

observations,  for  testing  hypotheses  H0]/H02'  *  *  •  ,H0k  *  To 
simplify  ideas,  we  assume  for  the  present  that  all  H  ^  axe  the  same,  for  instance, 
they  might  be  hypotheses  concerning  a  parameter  & ,  that  0  $  0Q  ,  where  0Q  is  a  set  of 


possible  values.  This  could  occur,  for  example,  in  the  example  of  testing 

mean  survival  time  using  results  from  k  hospitals.  Assume  without  loss  of  generalit 

A 

that  all  tests  are  so  defined  that  they  reject  for  large  values  of  the  statistics. 

Let  Fti;nJ  denote  the  null  distribution  functions  of  t(i;nj,  so 

that  p(i;n^)  =  1  -  F(i;nJ  is  the  observed  significance  level,  or  p-level,  of  the 

i-th  test.  To  obtain  Bahadur  efficiency  asymptotic  results,  we  shall 
suppose  all  n^  to  grow  steadily  larger,  and  also  suppose  that  the 
p(i;n.)  converge  to  zero  exponentially  fast,  that  is, 
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lim  {log  pCi;n.)}/n.  =  -  c.  C01/2  whenever  0  ^  0Q  . 

n.  ->  oo 

i 


The  value  (0)  is  called  the  exact  (asymptotic)  slope  of  the 
i-th  test.  Informally,  we  can  say  that  the  larger  the  slope,  the  better 
the  test  statistic  from  this  point  of  view  of  efficiency.  For  a  thorough 
discussion  of  these  ideas,  see  Bahadur  (11967) .  The  more  precise  definitions 


of  /,TP,TN,TM,  and  T1"  will  now  be  as  follows, 
let  qCi;nJ  =  1  -  p(jL;n.).  We  add  a  subscript  to 


and  have 

T* 

n 

< 

=  -  2Z  log  p(i;n.) 

(large) 

TP 

n 

»  -  2Z  log  q(i;n.) 

(small) 

N 

T 

n 

-  ^2  ^(qdjn.)) 

♦ 

(.large) 

_M 

T 

n 

=  max  p(i,*n  J 

(small) 

m 

T 

n 

=  min  p(i;nj 

(small) 

Suppose  n  =  Zn^,  and 
indicate  the  dependence  on  n, 


The  words  large  or  small  indicate  for  which  values  of  the  test  statistic 

the  overall  null  hypothesis  HQO  will  be  rejected.  In  order  to  derive 

PM  M 

overall  exact  slopes,  statistics  T  ,  T  and  T  must  be  converted  to 

n  n  n 

.  P 

reject  for  large  values,  as  will  be  done  for  Tn  below.  Also,  suppose 

each  n^  -*■  °°  ,  and  let  X^  =  lim  n^/n,  i  =  l,...,k.  Littell  and  Folks  (1971) 

show  that  the  exact  slopes  for  four  of  the  above  tests  based  on  the  combined 
statistics  are  respectively: 

CF(0)  =  Z.  X.  c.  (0) ;  CNC0)  =i[Z.CX.  c.tO))*1]2; 

1  1  X  K  XXX 

CM(.0)  =  k  min^  X^  c^(0);  Cra(0)  =  max^  X^  c^(0). 


Note  that  if  all  X  are  the  same,  implying  all  sample  sizes  n.  are  the 

i  i 

same,  and  if  the  slopes  of  the  individual  tests  are  the  same  C.=  C(.0)  say) 

the  first  three  exact  slopes  quoted  are  all  equal  to  C(0);  thus  in  the 
sense  of  Bahadur  efficiency  these  methods  would  be  equivalent.  We  now 

P 

examine  the  efficiency  of  . 

In  order  to  make  use  of  available  theory,  we  define  the  new 

*P  r  Pi3*  *P 

statistic  T  =  {-  log  T  }  .  Thus  we  have  T  significant  for 
n  n  n 

large  values.  We  then  have  the  result: 

Theorem  1.  Under  the  previous  assumptions  on  the  asymptotic  behaviour 

of  the  independent  sequences  of  test  statistics , 

*P  * 

T  has  exact  slope  k  min.  -X.c. (0)  . 
n  _ i  ii 

In  order  to  prove  Theorem  1,  we  first  obtain  2  lemmas. 

Lemma  1.1.  Let  the  n.,  n,  X.  be  defined  as  in  Theorem  1  and  let 

-  i  i 

{x  },  {y  },...,  {z  }  be  k  sequences  of  numbers  in  (0,1)  converging 
nl  n2  °k 

exponentially  fast  to  1,  that  is,  as  the  n^,  n  ->■  00  , 


-  —  log  CL  -  x  )  -»■  c,/2,  ...»  -  ■—  log  CL  -  z  )  c./2.  (1) 

nl  nl  1  nk  \  k 

Then 

1  *iCi 

lim  [ -  log{-2  log  x  -  2  log  y  -  ...  -  log  z  } ]  =  min  .  (2) 

n,n.  00  n  nl  n2  nk  l<i<k 


Proof  of  Lemma  1.1. 

We  show  the  result  for  k  =  2  since  the  extension  can  be  made  directly 


by  induction. 
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Let  B  =  -  —  log{-  2  log  x  -  2  log  y  }  and  observe  that,  for  large  n, 
n  n  "  " 


B  pa  -  —  log{-  log 


n  n 


x  y  J 
ni  n2 


Applying  the  inequality  1-u  <  -  log  u  <  (l-u)/u  for  u  €  (0,1)  to 

u  =  x  y  ,  it  is  readily  seen  that  B  pa  -  ~  log  Cl  —  x  y  ) .  Let  Z 
n^n,,  ■*  n  n  nl  n2 


be  the  minimum  of  x  and  y 

nl  n2 


Then  Z  5  x  y  5  Z  ,  and  so 
nl  n2 


(1— Z)  Cl+Z)  >  1  -  x^  y^  >1-Z.  Take  logarithms,  and  multiply  by  -  1/n; 

1  2 

for  large  n  it  follows  that  ~  —  log  Cl  -  x  y  )  ^  —  log  (1-Z) .  Thus 

n  n^  1^2  n 

Bn  -  -  “  log{-  2  log  xn  -  2  log  y„  J  «  ~  ^  log  (.1  ~  x^  )  «  -  ^  log (1-Z)  ; 


nl  n2 


nl  n2 


^1^*1  ^2°  2 

as  n  -*■  00  ,  the  limit -of  Bn  is  mini-— — ,  — - — }  from  Cl) .  This 

completes  the  proof. 


Lemma  1.2. 


Let  z  have  the  X2^  distribution.  Then,  as  n  -*■  00  , 


Lim  {-  —  log  P(z  <  e~ntl}  =  kt  . 


Proof  of  Lemma  1.2.  From  Johnson  and  Kotz  C1971) ,  p.  179,  we  have 

log  P(z<e  )=U  +  V  ,  where 

n  n 


U  =  log(n -  )  and  V  =  log  E  A  .  , 

"  2ltr(k)/2  "  j=0 


with  A 


t-1)  ^  (e~nt)  ^ 
n:i  23+1(k+j)  j : 


8 


00 

S  =  Z  Anj  is  an  alternating  series  with  terms  descending  in  absolute  value. 

Thus  _1_  e~nt  <  <  _1_ 

2k  "  2  ~  2k  ' 


so 


lim  S  =  —  and  hence 


lim(.V  /nl  =  0. 
n 


"I  »i. 

Also,  lim(Un/n)  =  -kt,  so  lim{-  —  log  P(z  <  e  }}  =  lim{~(Un  +  Vn)/n}  =  kt. 
This  completes  the  proof. 


We  now  proceed  to: 

Proof  of  Theorem  1. 

« 

*P 

In  order  to  obtain  the  exact  slope  for  T^  ,  Bahadur's  results  are 
used;  see  Bahadur  C1967) ,  p.  3Q9. 

*P 

Let  F  (.*)  denote  the  null  distribution  for  T  ;  we  first 
n  n 

show  that  for  each  0  £  0Q,  as  n  ->*  00  , 

X » c » 

Lim(Tn  //n)  =  (min  2  =  b(9),  a.s.,  and  (-3) 


Lim{-  —  logll  -  F  (yii  t)J}  =  kt^  =  f  (t)  ,  t  >  0  .  (.4) 

n  n 

Observe  that  (.3)  follows  directly  from  (21  in  Lemma  1.1,  by  setting 

x  =  1  -  pCl;n_),  y  =  1  -  p(2  ;n«l ,  etc.,  and  observing  that  the  LHS 
nL  1  n2 

*P  2 

of  (2)  is  then  (.T  )  /n  .  In  order  to  show  (.4)  ,  note  that 
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-  —  log{l  -  P  (j/nt) }  =  -  —  log  P(T  P  >  /nt)  =  -  —  log  P(TP  <  e  nt  ) ; 
nan  n  3  n  n  3  n 

P  2 

since  Tn  has  the  distribution,  application  of  Lemma  1.2  proves  (4)  . 

•Hie  notation  bC0)  and  f(.t)  is  used  by  Bahadur  (1967),  who 
then  shows  that  the  exact  slope  is  C(.0)  =  2f{b(,0)}.  Thus,  in  this 
application,  the  exact  slope  is 


CC0)  =  k  min  A.c.(.0). 

i  a. 


This  completes  the  proof  of  Theorem  1. 


*P  M 

Comment.  Theorem  1  shows  that  the  exact  slopes  of  T  and  T  are 
-  n  n 


the  same;  thus,  from  the  point  of  view  of  Bahadur  efficiency,  the  statistics 


PM 

T^  and  Tr  are  asymptotically  equivalent. 


3.  AN  EXAMPLE. 

In  Stephens  (1986,  Examples  8.15.1  and  8.15.2)  two  examples 

are  quoted  of  combining  test  results.  One  of  these  is  taken  directly  from 

Fisher's  first  illustration  of  his  test  method,  and  we  here  examine  this 

example  in  greater  detail.  The  subscript  n  will  now  be  dropped  from  the  test 

statistics.  Fisher  quotes  3  tests  of  significance  which  gave  p-values 

F 

of  0.145,  0.263,  and  0.087.  Then  T  is  11.42  and  in  the  upper  tail  of 
2 

X,.  the  overall  p-level  is  0.076.  The  q-values  are  0.855,  0.737  and 
6 

P  2 

0.913,  giving  T  =  1.105,  with  a  p-level  in  the  lower  tail  of  x6  equal 

to  0.018.  The  values  of  $  ^(q)  are  1.059,  0.634,  and  1.360,  so  that 
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N  N 

T  =  1.763.  The  null  distribution  of  T  is  N(0,1),  and  the  p-value 

is  0.038.  Also,  TM  =  0.263,  and  Tm  =  0.087;  the  null  distributions 

k  k 

are  respectively  F„(t)  =  t  and  F  (t)  =  1  -  (1-t)  ,  and 

M  m 

give  p-values  of  0.018  and  0.239  respectively.  Thus  the  p-levels  can 
be  summarized  in  the  following  small  table: 


F  P 
T  T 


0.076  0.018  0.038  0.018  0.239 


M  F 

Both  the  Pearson  statistic  and  T  are  more  sensitive  than  T 

in  this  example.  It  is  also  interesting,  in  view  of  the  results  of 
P  M 

Section  2,  that  T  and  T  give  almost  equal  p-values. 


4.  COMBINATIONS  OF  TESTS  BASED  ON  FINITE  SAMPLES. 

4.1  Densities  for  p-ievels  on  H„  or  . 

_ _ _  A  _  B 

We  have  seen  that  asymptotic  results  cannot  be  applied  to 

alternatives  to  h  of  type  H„  ,  where  some  H  .  might  be  true.  It 
oo  B  oi 

may  also  be  the  case  that  p-densities  for  H  alternatives  would  not 
always  satisfy  the  conditions  necessary  to  discuss  Bahadur  efficiency. 

In  this  section  we  therefore  examine  two  models  for  p-densities,  f^  and  f^ 
below,  which  have  been  chosen  because  they  might  reasonably  model  alternatives 
of  type  Ha  and  Hg  .  For  alternative  ,  all  p-levels  are  supposed 
to  become  small  together;  a  model  for  the  density  could  then  be 

f1(p;Y)  =  (Y+l)  d-p)Y,  Y  >  0,  0  <  p  <  1. 

This  density  approaches  zero  as  p  +  1,  and  gives  high  probability  to  small  p. 
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For  alternative  H  ,  where  some  h  are  true,  some  p-values  will 
B  oi 

remain  uniformly  distributed  U(0,1),  and  the  overall  p-density  can  be 
modelled  as 

f2(p;y)  =  ^p"(1“1/y),  y  >  i,  o  <  P  <  1. 

This  density  also  gives  high  probability  for  small  p,  but  nevertheless 

P 

is  non-zero  as  p  -*■  1.  It  is  well  known  that  T  is  the  likelihood  ratio 
.  F 

test  statistic  for  alternative  f^  ,  and  T  is  the  likelihood  ratio 
test  statistic  for  f^  . 

To  complete  the  study,  we  decided  also  to  construct  an  alternative 

non-uniform  family  that  would  allow  the  p-values  to  converge  exponentially 

0 

fast  to  zero.  We  call  this  alternative  f  (p;y).  It  corresponds  to  a 

*  * 

-I 

-  2 

p-value  constructed  a^  follows.  Let  p  =  e  .  x  ,  where  x  is  taken  from  a 

standard  exponential  distribution,  but  conditional  on  x  <  eY^2,  so  that  p  <  1. 
For  large  y  ,  f^ipty)  has  the  following  properties,  where  E  and  V  denote 
mean  and  variance. 


E{-  i  log  p}  =  _L  ^  I 


2n"  "  n  EQ°3  *> 


V{-  £  log  p}  =  -LvOLog  k)  . 
n 

E<109  “d  V<1°9  Y  ;  as  y  -*■  <»  their  values  are 

F'111  =  "5772  “4  f"  (1)  '  where  r<x,  tootes 

gamma  function  and  P  r»  fc)  its  first  two  derivatives. 

So.  if  (x  . x™},  {x^2) .  . {  (m)  (m), 

K  1  *  '  XX1  ,***'Xk 


-  12  - 


is  an  infinite  sequence  of  standard  exponential  samples,  then  by  setting 
n.  =  n/k,  X.  =  ,  y  =  Cn.  ,  and  defining 

1  X  K  X 

“  2  (V 

p(i;n^)  =  e  x^  ,  we  have 

(n  > 
log  xt 

{log  ptijn,)}/^  =  Zin/) ,  say,  =  -r/2n  +  - - -  . 

j,  £ 

Then  E{z(n.)}  =  -  |  +  E(1°g-X)-  ^  V{z(n  )}=-—■  V(log  x)  . 

1  2  ni  1  n.2 

As  n^  00  ,  so  that  y  -*•  00  ,  we  have 


Q 

lim  E^tn.^)}  ~  ~  2  3113 

n  ->-oo  '** 

i 

2 

and  v{z(n.)}  -*■  0  as^  1/n.  ;  thus  by  the  Borel-Cantelli  lemma, 

X  X 

Z(nJ  ■*  C/2  almost  surely. 


4.2  Monte  Carlo  results. 

Tables  1  and  2  report  a  Monte  Carlo  study  with  10,000  samples,  for  each 
of  which  k  =  5  or  k  =  10  values  of  p  are  used  in  the  overall  test 
statistic.  For  alternatives  f^  (Table  la)  and  f 2  (Table  lb) ,  the  power 
of  four  of  the  test  statistics  is  given  for  2  different  test  levels  a  and 
for  various  values  of  y  •  (Tm  does  badly  throughout  and  is  not  reported) . 

P 

The  table  shows  that,  as  expected,  T  does  better  against  alternative  f^ 

F 

and  T  against  f 2  .  An  interesting  feature  is  the  relatively  good 

performance  of  the  other  statistics  in  Table  la  (alternative  H  ) ,  and  especially 

of  TN  in  Table  lb  (alternative  H  ) . 

B 
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In  table  2,  y  must  approach  00  for  asymptotic  comparisons 

to  apply.  Since  y  =  cn^  ,  and  all  n^  are  equal  then,  as  mentioned  in 

Section  2.1,  all  tests  have  the  same  Bahadur  efficiency,  a  fact  which  can 

be  seen  from  the  table.  For  smaller  values  of  y  the  table  indicates  the 

approach  of  each  of  the  tests  to  equal  efficiency.  It  is  clear,  however 

P  N 

that  for  smaller  values  of  y  ,  T  and  T  are  again  more  effective 
F  M 

than  3?  or  T  in  this  equi-sample  situation. 

These  results  point  to  the  following  conclusions.  Asymptotic 

F 

considerations  of  Bahadur  efficiency,  which  indicate  that  Fisher's  T 

will  be  the  best  statistic  for  considering  test  results,  can  be 

misleading  when  (a)  the  individual  tests  are  based  on  relatively 

small  samples  and  (b)  the  alternatives  to  are  or  above; 

* 

P  N 

then  Pearson's  statistic  T  ,.  and  the  "normal  scores"  T  can  often 

_  «*' 

F 

be  superior  to  T  .  Such  situations  can  quite  possibly  occur,  so  that  it 

P 

seems  wise,  m  the  practical  analysis  of  data  sets,  to  calculate  T  and 

N  M  F 

T  ,  and  possibly  T  ,  along  with  T  .  Although  tests  using  all  the 

statistics  will  then  change  the  overall  a- level,  the  statistics  themselves 

will  throw  light  on  the  possible  alternatives  to  . 
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Table  1 


Power  of  4  combined  test  statistics  against  alternatives  f^('p;y)  or 

The  table  gives  the  percentage  of  10,000  samples  significant  when  k  =  5  or 
k  =  10  values  p  are  taken  from  f^  (Table  la)  or  f^  (Table  lb)  and  combined 
by  the  test  statistics.  The  two  test  levels  are  a-  =  0.01  and  a  =  0.05. 


Table 

la. 

a  =  0 

.01 

k  = 

5 

a  =  0 

.05 

Y 

F 

T 

M 

T 

TP 

_N 

T 

_M 

T 

TP 

_N 

T 

1 

7 

8 

10 

9 

23 

30 

36 

32 

2 

16 

27 

34 

28 

49 

61 

70 

63 

3 

31 

48 

58 

50 

66 

81 

89 

83 

4 

46 

66 

77 

66 

81 

91 

9.7 

93 

5 

57 

79 

88 

79  _  ■ 

90 

95 

100 

98 

6 

68 

*86 

94‘ 

88 

94 

98 

100 

100 

7 

77 

92 

97 

93 

98 

99 

100 

100 

8 

83 

95 

100 

96 

99 

99 

100 

100 

9 

88 

97 

100 

98 

99 

100 

100 

100 

10 

93 

98 

100 

)99 

100 

100 

100 

100 

20 

100 

100 

100 

100 

100 

100 

100 

100 

k  = 

10 

1 

14 

22 

30 

26 

40 

51 

66 

58 

2 

42 

61 

81  ■ 

69 

78 

84 

97 

94 

3 

70 

83 

98 

93 

95 

96 

100 

100 

4 

89 

94 

100 

99 

100 

99 

100 

100 

5 

97 

98 

100 

100 

100 

100 

100 

100 

6 

99 

99 

100 

100 

11 

II 

II 

II 

7 

100 

1Q0 

100 

100 

11 

11 

II 

11 
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Table  lb. 

a  =  0 

.01 

k 

=  5 

Y 

T* 

TP 

2 

32 

8 

14 

3 

66 

19 

31 

4 

85 

28 

45 

5 

93 

38 

57 

6 

96 

45 

64 

7 

98 

51 

70 

8 

99 

56 

73 

9 

100 

60 

76 

10 

100 

63 

78 

2Q 

100 

79 

91 

k  = 

10 

2 

53 

8 

21 

A 

3 

89 

20 

50 

4 

98 

32 

68 

5 

1Q0 

39 

77 

6 

100 

46 

83 

7 

II 

52 

88 

8 

tl 

57 

91 

9 

tl 

60 

92 

IQ 

It 

64 

93 

20 

It 

81 

98 

a  =  0.05 


_N 

T 

mF 

T 

T 

TP 

_N 

T 

26 

52 

19 

30 

46 

58 

82 

34 

51 

75 

77 

93 

46 

65 

89 

88 

97 

55 

73 

95 

94 

99 

61 

78 

98 

97 

100 

65 

81 

99 

98 

100 

69 

85 

99 

99 

100 

72 

87 

100 

99 

100 

74 

89 

100 

100 

100 

86 

95 

100 

45 

74 

22 

44 

67 

84 

96 

37 

71 

93 

96 

100 

47 

83 

99 

99 

100' 

55 

89 

100 

1Q0 

100 

62 

92 

100 

It 

100 

66 

94 

100 

II 

100 

69 

96 

.  100 

It 

100 

73 

97 

100 

II 

100 

75 

97 

100 

II 

100 

86 

99 

100 
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Table  2 

Power  of  4  combined  test  statistics  against  alternative  f3(p;Y)» 


The  table  gives  the  percentage  of  10,000  samples  of  significant  when 


k  =  5  or 

k  ---  10 

values  p 

are 

taken  from 

f  (Table  2) 

and  combined 

by  the  test  statistics. 

The 

two 

test  levels 

are  a 

=  .01 

and  a  =  .05. 

a  =  .01 

a  = 

.05 

F 

M 

p 

N 

F 

—M 

P 

_N 

Y  T 

T 

T 

T 

T 

T 

T 

T 

1  6 

7 

9 

8 

21 

21 

25 

25 

2  13 

17 

21 

19 

37 

40 

48 

47 

3  32 

42 

52 

47 

67 

68 

80 

79 

4  66 

77 

88 

83 

93 

92 

98 

98 

5  92 

96 

99 

98 

100 

99 

100 

100 

Y 

F 

T 

k  =  10 

M 

T 

TP 

N 

T 

tf 

T* 

TP 

N 

T 

1 

12 

11 

17 

17 

33 

25 

40 

41 

2 

31 

27 

45 

45 

62 

47 

40 

41 

3 

70 

61 

85 

86 

92 

77 

96 

97 

4 

97 

91 

100 

100 

100 

96 

100 

100 

5 

100 

100 

100 

100 

100 

100 

100 

100 
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